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Synaptic plasticity of Inhibitory synapse promote synchrony in inhibitory network in 
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Recently spike timing dependent plasticity was observed in inhibitory synapse in the layer II of 
entorhinal cortex. The rule provides an interesting zero in the region of At = tpost — tpre = 
and in addition the dynamic range of the rule lie in gamma frequency band. We propose a robust 
mechanism based on this observed synaptic plasticity rule for inhibitory synapses for two mutually 
coupled interneurons to phase lock in synchrony in the presence of intrisic heterogeneity in firing. 
We study the stability of the phase locked solution by defining a map for spike times dependent 
on the phase response curve for the coupled neurons. Finally we present results on robustness of 
synchronization in the presence of noise. 
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It is generally accepted that inhibitory interneurons 
are important for synchrony in neocortex. Several stud- 
ies have reported the role for inhibitory interneurons 
in generatinff stable synchronous rhythms in neocortex 
[H H; Hi |ji I3 ' Cortical oscillations in the gamma fre- 
quency band (20-80 Hz), are thought to be involved in 
binding of object properties, a process of great signif- 
icance for the functioning of the brain. These experi- 
mental findings have led to numerous theoretical studies 
of synchrony among inhibitory interneurons [S l3i S ISl • 
The principle result of these studies showed that depend- 
ing on the decay time of the inhibitory synaptic coupling, 
the mutually coupled inhibitory neurons oscillate in syn- 
chrony ( in phase locking) or in antisynchrony (out of 
phase locking). However much of the above investiga- 
tions did not explore the effects of heterogeneity in the 
intrinsic firing rates nor did they take into account noise, 
which is invariably present in neuronal systems. 

In another set of theoretical investigations, [I3 ex- 
plored the implications of small heterogeneity for the 
degradation of synchrony of fast spiking inhibitory neu- 
rons and the mechanism by which the degradation occur. 
They found that introduction of even small amounts of 
heterogeneity in the external drive, resulted in significant 
reduction in coherence of neuronal spiking. It is impor- 
tant then to understand what mediates observed in vivo 
synchrony of neuronal networks under biological realis- 
tic conditions of noise induced unreliability and intrinsic 
heterogeneity in spiking rates of the neuronal ensemble. 

In this letter we propose a robust mechanism based on 
spike timi ng d ependent synaptic plasticity of inhibitory 
synapses [13 by which two coupled interneurons can 
phase lock in synchrony even under conditions of mild 
heterogeneity in the firing rates of the coupled neurons 
and in the presence of noise. Earlier work [ig has ex- 
plored the function of synaptic plasticity in the excitatory 



synapse in improving synchronization in unidirectionally 
coupled neuronal network. We consider a network of 
two coupled interneurons with self inhibition as shown 
in Figure ^. The self-inhibition is introduced because 
biological neural networks often have local inhibitory in- 
terneurons which deliver feedback inhibition to the cells 
activating those interneurons |l7| . The importance of 
self inhibition that simulates the network effect, is ex- 
plored in details in 19j. 

Each neuron in the coupled network is modelled as 
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where Vi(t) (i=A,B) is the membrane potential , Q{t) 
is the gaussian synaptic noise of amplitude rj satisfy- 

ing (C(i)) = and (o(i)C,(i')) = Sit - t)S,^. J}„, is 
the external drive, /^(i) = gsS{t,V,{t)){Ei - V^{t)), is 
the synaptic current due to self inhibition and I^l[{t) — 
gj-^iS{t,Vj{t)){Ei — Vi{t)) is the synaptic current from 
mutual inhibition. gj^i = gmG{t) is the dynamic 
synapse, whose strength is determined by the inhibitory 
synaptic plasticity rule, and gs is the synaptic strength 
of self inhibition. Er (r=Na, K, L) are reversal po- 
tentials of the sodium and potassium ion channels and 
the leak channel respectively. Ei is the reversal poten- 
tial of the inhibitory synapse. S{t,V{t)) give the frac- 
tion of bound receptors and satisfy the first order ki- 



netic equation, S{t) 
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where Vpre{t) is 
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the presynaptic voltage. It involves two time constants, 
Tr = t{Si — 1), the docking time for the neurotransmitter 
and Td — tSi, the undocking time constant for the neu- 
rotransmitter binding. So{V) is the sigmoidal function 
given by, SoiV) = 0.5(1 -htanh(120(T/ - 0.1))). The gat- 
ing variables X(t),(X=m,h,n), satisfy first order kinetic 
equations, X{t) = ax{V){l - X{t)) - (3x{V)X{t). We 



have used standard functions aj5s:(y) and PxiV) and pa- 
rameters for the model [ig, such that the dynamics of 
the neurons to spiking is through saddle node bifurcation 
and the model represents a type I neuron 20] . The model 
parameters are within physiological range and give high 
spike rates typical of interneurons. 

We consider two regimes of operation of the network 
shown in Figure ^. The two regimes called the pha- 
sic regime and the tonic regime fl3| are determined from 
the firing characteristics of a single self inhibited neu- 
ron (Figure ^) . In the phasic regime the network pe- 
riod depends on the synaptic decay constant [13 and 
in the tonic regime the synaptic dynamics weakly affect 
the network period. These two regimes of operation are 
clearly illustrated in the plot of r^/T, which is the ratio of 
synaptic decay constant to the firing frequency of the self 
inhibited neuron versus r^ in Figure^ for various values 
of //„ and gs . These two regimes of network oscillations 
were observed earlier [lj|, with the synaptic model for 
the inhibitory synapse, obeying the first order kinetic 
equation, S{t) = F{V){1 - S'(i)) - S{t)/Td. Changing 
Td in this situation not only changes the decay time of 
the synapse but also the rise time given by t^ = r fJv)+i 

and the saturation level of the synapse Smax — ^^j./yJ^ . 
As a result a narrow region of higher harmonic phase 
locking was observed between the coupled interneurons 
in the phasic regime. We have therefore considered the 
synaptic model presented above where we have control 
over the decay time for the synapse independent of the 
rise time and the saturation level of the synapse. Earlier 
work [lj| has shown that in presence of mild heterogene- 
ity, coherence in neuronal firing is observed much more 
for phasic regime than in tonic regime. In the results 
presented here we therefore consider the phasic regime 
of the network operation and study the effect of STDP 
in inhibitory synapses, in maintaining coherence in neu- 
ronal firing in presence of heterogeneity and noise. De- 
tails on the calculations for the tonic regime will appear 
elsewhere [l^ 

In all the subsequent calculations, we fix the pa- 
rameters of the model in the phasic regime, (//„ = 
2.5^A/cm^, gs = gm — O.lraS/cm? , r^ = 1.1 ms, 
Td = 5.0 ms) and study the effect of the dynamic synapse 
in maintaining synchrony in presence of heterogeneity 
and intrinsic noise. In figure ^, we plot the ratio of 
mean firing periods 'iq?^ for the two coupled neurons A 
and B as function of heterogeneity in the external drive, 



defined as H ^ 100 
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in absence of noise i.e., 77 = 0. 



As can be seen from FigureQJi, (top panel), the region of 
1:1 locking, as function of heterogeneity is much broader 
in the phasic regime of network operation as compared 
to the tonic regime, where we set /^ = b.Q^A/cm?. In 
addition, higher order synchronization are also present in 
the phasic regime, as a result coherence between the two 
neurons is preserved more often in the phasic regime of 
the network operation. 

A spike timing dependent plasticity (STDP) rule for in- 



hibitory synapses has been recently reported in 15] and it 
has the form A5(Ai) = ^^a'^IAijAi'^-ie^"!^*!, where 
Ai = tpost — tpre- tpre is the time of presynaptic spike 
stimulation and tpost is the time of a spike generated by 
the postsynaptic neuron, go is the scaling factor account- 
ing for the amount of change in inhibitory conductance 
induced by the synaptic plasticity rule and gnorm = Pe~^ 
is the normalizing constant. An empirical fit of the above 
function to the data gives, a = 1 and (3 = 10, giving a 
window of ±20 ms over which the efficacy of synaptic 
plasticity is non zero. This implies that in the physiolog- 
ically important regime of gamma oscillations (25-80 Hz), 
STDP rule of inhibitory synapses can play a significant 
role in modulating the firing dynamics of the neuronal 
network. 

We now consider two situations in the phasic regime: 
when the strength of mutual inhibition is static: gA^B = 
gB—>A = ffm and when the mutual inhibition strength 
is dynamic and governed by observed synaptic plastic- 
ity rule, i.e., gA^B = .9m(l + ^.9(*)) and gs^A = 



ffm(l —git))- In order to take into account the ef- 
fect of multiple spike pairs, we follow [13 and define 
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9(t) = EjE.A5(At,,)efef , where AU, = tf - t 
the difference in spike times of neurons A and B respec- 



tively. 



A,B 



gives the efficacy of spike in A and B and 



is defined as ef- 
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We take t^ « 55ms, 



an average of the efficacy values given in jiy| as experi- 
mental results on contribution of multiple spike pairing 
to inhibitory synaptic plasticity are as yet unknown. In 
Figure|3i we plot the ratio <Tb >/ <Ta > as function 
of heterogeneity H in the static and dynamic case. 

As shown in Figure 13^ there is considerable increase 
in 1:1, 1:2 and 2:1 synchronization windows mediated 
by the dynamic synapse in the phasic regime. This 
implies an increased probability of observing coherence 
in the firing pattern of the mutually coupled interneu- 
rons even in presence of mild heterogeneity as has 
been reported in many in vivo experimental data. In 
Figure ^jp ,we show the evolution of phase difference 
^fB ^ (^i^B _ ^A| j^qJ <Ta>) in the static and dy- 
namic case, with heterogeneity of 6 %. We see that in 
the static case the phase difference grows linearly modulo 
< Ta >, representing situation of asynchronous firing. 
However in the dynamic case, after the initial transient 
is over, the phase difference saturates to a fixed value, 
(1.4 in this example), representing stable 1:1 locking be- 
tween the two mutually coupled neurons. In Figure ^ 
we plot the evolution of the synaptic strength as function 
of time. We see that the STDP rule results in modulat- 
ing the synaptic strength so as to phase lock the two 
mutually coupled neurons. 

In order to understand the dynamics of phase locking 
under heterogeneity in the presence of dynamic synapse, 
we consider the situation initially in the static case. Let 
the two coupled neurons fire heterogeneously with intrin- 
sic firing period T^ and T'^ when they are uncoupled. In 
the case of 6 % heterogeneity, we have /j^ > /^ so that 




FIG. 1: (a) Schematic diagram of the self inhibited neuron considered to determine the different regimes of operation of network 
of mutually coupled interneurons. (b) Schematic of the mutually coupled interneurons. (c) Ratio of the synaptic decay constant 
Td to firing period T plotted versus Td- Parameter values for the operation of the neuron in the two regimes, are shown, (d) The 
ration of firing period of two coupled neurons in phasic and tonic regimes are plotted as function of heterogeneity in external 
drive. 



T4 < Tg. Let (j){e) be the phase response curve of the 
neuron model. It is known that for type I neuron mod- 
els, the phase response curve is positive |23|, and as a 
result every time a spike arrives, the phase of subsequent 
spike is delayed. In the situation considered, with initial 
phase difference between the two neurons set to zero, the 
spike times of individual firing neurons can be written 
as, tf = tf_^+T% + 0^(ef_i), (K=A,B) with ef_^ > 0, 
where ef ^ tf - tf and ef = tf_^^ - tf . tf is the time 
of f^ spike of neuron K. The map evolving the phase 
difference -0^^ is then. 






V^^'i^t^) 
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where -q^" {x) = (t)^{x) - (j) {< Ta > -x). The fixed 
point of the map is then given by 



^^{^f^) = T%-Tl 



Numerical solution to above equation gives the fixed 
points, at ij^^^ « 3.85 as can be seen in Figure El 
where we plot rj{%l;^^) versus i/''^^- Stability of the 

fixed point would require |1 



dx 



\x—il)-^^ 



< 1 => 



0< 



dv^fix). 



<2 



Ix^ip-^' 



-2.5 for the 



dx \x=il>C 

For the set of parameters considered however, the nu- 
merical value obtained for — — — 
fixed point. 

Thus we see that when the synapse is static the phase 
difference is unstable and the two coupled interneurons 
fire asynchronously in the situation of 6% heterogene- 
ity. Now consider the situation in the dynamic synapse 



case. Again setting the initial phase difference zero, in 
the presence of dynamic synapse with STDP, we have 

^f = *f-i+TK + ^^{^f-i^~9]-iit)), where phase shift 
given by the phase response curve also depends on the 
dynamics of the synaptic coupling strength governed by 
the STDP rule. The map function for evolution of the 
phase shift ^^^ is then obtained as. 
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). The fixed 
TO-T". As 



where r]^^(x) = (f)'^ (x) - (f)^ {< Ta > - 
point of the map is then given by fj (x) 
can be seen from Figure 3b, where we plot ij {ip ), 
in the steady state {t — > 00), when qb^a = -146 and 
= 0.054, we obtain, ^pff « 1.4 and tp. 
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Stability of the fixed point given by < — -r \x=i;^ 

2, implies ip-^^ ~ 1.4 is stable as can be also seen from 
the time evolution of phase in Figure |2b- Thus we see 
that STDP of inhibitory synapse, modulates the phase 
response curve such that the network locks into syn- 
chrony even under mild heterogeneity. In Figure ^ we 
present results on synchrony in presence of noise. We 
set the noise amplitude 77 = 0.1 in equation 1. For mild 
noise, STDP of inhibitory synapse, is able to maintain 
synchrony between the two coupled interneurons under 
conditions of mild heterogeneity in the drive. 

We have also tested the dynamics of the network in the 
tonic regime. STDP of inhibitory synapse, also signifi- 
cantly increases the window of synchronous oscillations 
by the same mechanism |l9l |. 

It has been suggested in [13 that plasticity of in- 
hibitory synapses may play an important role in balanc- 
ing the effect of excitatory synapse preventing run away 
behavior typically observed in epileptogenesis. In this 
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FIG. 2: (a) Ratio of firing periods of tfie two coupled interneurons, in the static case, when the inhibitory synaptic strength 
is constant and dynamic case when the inhibitory synaptic strength is modulated by STDP rule, is plotted as function in 
heterogeneity H. (b) The evolution of phase difference ^ ^ is plotted in the static and dynamic case, when the heterogeneity 
is set at 6 %. (c) The evolution of the inhibitory synaptic strength between the two coupled interneurons, A and B is plotted 
as function of time. 
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FIG. 3: Plot of the difference in phase response of the two 
coupled neurons in the static rj ^ and the dynamic case, fj ^ 
is plotted as function of the phase difference. Stability anal- 
ysis on 77'*^ and fj^^ , determines whether the two coupled 
neurons will phase lock with each other. 



work we present an important function for STDP in in- 
hibitory synapse in maintaining synchrony in networks 
of coupled interneurons, under biologically realistic situ- 
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FIG. 4: Ratio of firing periods < Ts >/< Ta > is plotted as 
function of heterogeneity H, in presence of synaptic gaussian 
noise with amplitude a=0.1 



ation of mild heterogeneity and noise. 
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